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A model of the educational process and a derived procedure series for 
implementing an individualized instruction system are presented. The application of 
computer technology to individualized instruction requires an operational definition of 
the educational process in terms of school practices. A process model involving three 
major sets of variables, educational goals, individual capabilities and instructional 
means, with means a function of goals and capabilities, is outlined. Following upon this 
conceptual model, an instructional model and the functional basis of an individually 
prescribed instruction (IPI) system are developed as a sequence of operations. As 
instruction proceeds, performance is monitored and assessed, and necessary 
adaptations occur at subgoal decision points. The system is also evolutionary; it is 
able to compare interim student behavior and final outcomes with predictions of 
original operational functions and provide the basis for modification when 
appropriate. Experience obtained in introducing computer assistance into a currently 
operational IPI system is described at length, and system research abilities, including 
a cumulative data bank for basic learning and measurement studies, are discussed. 
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AN INFORMATION AND MANAGEMENT SYSTEM 
FOR INDIVIDUALLY PRESCRIBED INSTRUCTION 1 
William W. Cooley and Robert Glaser 
Learning Research and Development Center 
University of Pittsburgh 



One of the most important potential uses of computers in schools 
is to individualize the educational process. However, as the history 
of attempts at individualization indicates, little can be accomplished 
unless the educational process is operationally defined and translated 
into specific school practices. The basic requirement for this is the 
presentation of an instructional model which underlies and generates 
(a) the operations and procedures (materials, school environment, and 
teaching practices) that need to be carried out and (b) the data and 
research information required to perform the educational functions in 
an effective way, according to the expressed aspirations. 

Therefore, before any fruitful discussion can begin on how the 
computer might facilitate such education, it is necessary to make expli , ~ 
cit just how individualization is to be accomplished. The instructional 
model can serve as the beginning of a system which can then be improved 
by information obtained from its application. If the model is absent, 
or ambiguous, it is difficult to structure operations and essentially 
impossible to make continuous improvements in the total educational 
system. It is in this light and as a starting base for discussing the 
individualized school and the computer that we present a model of 
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educational practice which can underlie Individualized Instruction, 
j Stated simply, individualized education Is defined as adapting 

instructional practices to individual requirements. Three major facets 
‘ are involved, each of which defines a set of variables in the systems 

j (1) educational goals, (2) individual capabilities, and (3) instructional 

I 

means. Goals are defined to suit the individual, as when individuals 

f 

I choose different courses of Instruction for different vocational aspira- 

i 

jf 

I tions. Individual capabilities refer to the competencies which the indi- 

| 

vldual brings to a particular instructional situation; these capabilities 

l 

are influenced by prior background and schooling. Instructional means, 

[ which include what is taught and how it is taught, are dictated by both 

r 

the nature of the individual’s capabilities and the nature of educational 
goals. These three aspects may change in the course of one’s education 
or one's life, but in any particular span of time, during a specific 
teaching act, it is assumed that certain values of these major kinds of 
[ variables are presents we assume that particular capabilities of the 

individual are present; we assume that a particular educational goal or 
level of competence is to be attained; and we assume a set of available 
j instructional means and conditions relevant to assessed capabilities and 

criteria of competence. 

Thinking about the educational process in this way suggests the 
j following general instructional model which is presented as a sequence of 

operations (Glaser, 1969). 

f 

1. The goals of learning are specified in terms of observable 

j 

b student behavior and the conditions under which this behavior is to be 

; 

exercised. 

I 

f 

\ 

I 

i 
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2. Diagnosis Is made of the Initial capabilities with which the 
learner begins a particular course of Instruction. The capabilities that 
are assessed are those relevant to the forthcoming Instruction. 

3, Educational alternatives adaptive to the Initial profile of the 



student are presented to him. The student selects or Is assigned one of 
these alternatives. 

4. Student performance Is monitored and continuously assessed as 
the student proceeds to learn. 

5. Instruction proceeds as a function of the relationship between 
measures of student performance, available Instructional alternatives, 
and criteria of competence. 

6. As Instruction proceeds, data are generated for monitoring and 
Improving the Instructional system. 

The Implementation of these operations requires both research and 
application. The model can be Implemented along a continuum of various 
degrees of automation. It Is possible to begin without automation at all. 
Teachers and teacher aides, with a redesigned school organization and 



appropriate tests and materials, can carry out Individualized Instruction 
In a particular school. Individually Prescribed Instruction (IPI) during 
Its early years at the Oakleaf School (Glaser, 1968; Llndvall and Bolvln, 
1967) has been such a non-automated version. There Is no necessary correl- 



ation between the effectiveness of Individualized education and the degree 



of automation Involved. Only If the required operations are carried out 
In a manner adaptive to the Individual, can the system be effective. 
Automation can Implement a good system as well as a bad one. However, 

It seems possible that automation canbe a significant aid to the conduct 
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of an Individualized system and to the collection of research data 

so that the system can be Improved. 

Automation can be Introduced In Individualized education as a means 

of assisting the teacher In carrying out and managing the process. Here 
the computer can service classroom terminals which assist the teacher In 
diagnosing and prescribing a course of Instruction for the student. When 
automation Is used In this way In an Individualized setting. It has been 
referred to as "computer-managed Instruction" (CMI). In CMI, the primary 
function of the computer Is to assist the teacher and student In planning 
instructional sequences, where the actual instruction may be self-instruction 
packages (automated or not), or more conventioanl instruction. On the 
other had, when the computer is used by the student as a means , of Instruc- 
tion, the term commonly employed is "computer-assisted instruction (CAI). 
Both CHI and CAI carry out educational functions, and the relationship 
between them is an inclusive one: CMI can occur without CAI, but if CAI 

is used, the information necessary for CMI is usually present. Between 
these two there are shadings, as when the computer is used for such adjunct 
purposes as testing, special laboratory exercises, data analyses, etc. 

The general model of instruction presented can be carried out in 
three modes: non-automated , CMI, or CAI. It is highly probable that 

increasing levels of automation can improve individualized education, but 
only if more is learned about adapting education to individual require- 
ments. A CMI system can obtain such information in addition to its uses 
for operational implementation. The non-automated version, the early 
years of the Oakleaf School, represents a first application of the general 
instructional model. After a period of pilot work, CMI is being introduced 
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to speed up the collection and analyses of the data required for the 
redesign of an Improved system. 

Instructional Decision Making 

All teaching involves decisions about how Instruction should pro- 
ceed. Particularly characteristic of Individualized Instruction Is the 
necessity for Instructional decisions relevant to each student. The dif- 
ferential decision-making function in Individualized instruction Is a 
central issue. These decisions require a great variety of Information 
about the individual student, such as: (a) What criteria of competence 

should be applied? These have been traditionally stored in terms of test 
grades, teacher judgments of quality, etc. (b) What is the background of 
the student? This has been stored in the student's written record in 
terms of intelligence test and aptitude test scores, (c) How does a 
student proceed in his learning? This is usually the teacher's impression 
of the student as slow or fast, or attentive or dis tractable, and rarely 
takes the form of documented information, (d) What instructional means 
are available for teaching certain lessons? This has been catalogued in 
the teacher's head or on a resources list. In the model of Individualized 
instruction envisioned here, a sizable amount of information is needed 
for each student on a dally basis. It is obvious that some form of assist- 
ance is necessary to help the teacher store and act in terms of such data. 

A computer management system has as its objectives the collecting 
and processing of information on each student and supplying this informa- 
tion to the teacher in a summarized form so that it is directly applicable 
to human decision making. It is possible that at each decision point, 

£ata can be summarized for the teacher at his request or supplied to him 
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tlonal decision making. 

Implementation of a System for Individual ized Instruction 

It is appropriate to examine the procedures that would be carried out 
in an indiviudalized school proceeding according to the model previously 
mentioned. The system is oriented around the instructional decisions required 
for adapting the educational environment to each student. The procedures 
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involved supply information sbout the student to both the teacher end the 
student; information is further supplied about the effectiveness of the 
instructional alternatives (procedures and materials) that are used in the 
school. 




1. Specification of goals, subgoals, and decision nodes . Educa- 
tional goal-setting is a complex problem that cannot be Ignored; in fact, 
goals are inevitably involved, whether explicitly or implicitly, whenever 
instruction takes place. The educational technologist does not set the 
goals for American education. Instead, his task is to identify goals 
which are espoused in his society and then to develop the procedures for 
achieving those goals. When he has finished his task he can say to edu- 
cators, parents and students! If you have goal A, then consider doing 
X, Y, and Z. The eventual result is a variety of goals from which the 
learner is then free to select and for which instructional means are 
defined and made available. 

Schools must provide not only the means toward a variety of goals, 
but also the mechanism whereby goals can be identified or selected for 
each student. Although selecting goals is often seen as a guidance function 
differentiated from subject-matter teaching, the two functions are not sep- 
arable. The guidance technology required to Institute a system of goal 
setting on an individualized basis must be defined and implemented if an 
individualized school is to function with alternative goals and alternative 
paths toward these goals. No one will argue that all students should have 
the same educational goals nor that goals must remain constant for a given 
student, although it is probably true that the goals of elementary school, 
directed toward teaching fundamental skills and knowledge, permits less 



miia 






aaMajaassaaia^^ 




frnrnimmmmm 
























lUtifflikfi £93 ^^{SjiSjI^'.SSS*. , • T-, f7T> SS&ffi&S' iitS&lS-. ^ 



8 



freedom for goal setting than later schooling. Up to a point In the 

Individualized elementary school* choice Is more among Instructional 

3 

means than among more ultimate goals. 

The specified goals for a given student Imply a series of subgoals. 

The arrangement of these subgoals is a function of the structure of the 
subject-matter goal; which have been selected, the approach of the course 
designer to the subject matter, and also the way in which the student 
elects, or his performance advises, th»t instruction should proceed. 
Different students may follow different paths through these subgoals so 
that for any particular individual the subgoals may be omitted, added to, 
recombined or rearranged. These changes take place as a function of the 
instructional steps described later in this paper. A major point at this 
time, however, is that the subgoals provide nodes at which instructional 
decisions are made by the teacher with the aid of the psychologist via the 
computer. Experience and research data collected can serve to "validate 
subgoal hierarchies, permissible paths, etc. Specifying subgoals essen- 
tially involves describing student behavior and ways of measuring it. 

Data obtained serve to establish the effectiveness with which this is done. 

2. Measurement and diagnosis of the initial st ate or behavior with 
which the student enters an instructional situation . Initial diagnosis 
requires two kinds of information, long-term history and short-term 
history. Long-term history refers to information on student background 
characteristics such as intelligence, aptitudes, etc. Short-term history 
refers to the student's performance during recent instruction in relevant 
subject matter. In a CMI system* a teacher would have access to a profile 
of test information (both long-term and short-term) from a computer terminal 
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and would be able to ask specific questions about the characteristics of 
each student. One step further in CMI, the computer could be used to Rive 
subject-matter placement tests specific to the course of instruction, and 
the results put in the student's record. The teacher could examine the 
data and make decisions about student placement. As a further step, sug- 
gested placement decisions could be displayed for the teacher, and he 
could accept, reject, or amend these suggestions on the basis of a perusal 

of the record. 

The necessary research for developing this aspect of an individualized 
system vould be study of the reliability of the placement tests and their 
relationship to instructional decisions in terms of maximizing the success, 
learning efficiency and motivation of the student. As such information is 
obtained, placement decisions could become increasingly useful. 

3. The assignment of instructional alternatives . On the basis of 
the information obtained from the diagnosis in the previous step, a stu- 
dent is assigned, guided to, or allowed to select means of instruction. 

In CMI, the range of instructional alternatives could be displayed on the 
classroom terminals either for the student or teacher to choose from. 
Various allocations of teaching resources could be suggested to the teacher 
by indicating which students might be available to tutor other students 
and which students might be grouped together for a discussion of teacher 

presentation. 

A basic question in the design of instruction is what instructional 
alternatives are made available and how are they decided upon. On what 
basis do alternative instructional experiences differ so as to be adap- 
tive to individual requirements? Adaptation can take place on the basis 
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of the different content relevant to different subgoals; adaptation can 
also take place on the basis of Instructional procedure. The student’s 
placement profile can indicate the student’s present level of accomplish- 
ment and his mastery of prerequisites. General intelligence measures may 
suggest whether or not the student requires more or less closely sequenced 
instruction and whether or not the student can effectively manage his own 
progress. However, these relationships are far from clear. Aptitude 
measures of the kind used in typical present-day aptitude batteries may 
be somewhat predictive of long-term academic and vocational success and. 



as a result, assist the student in the selection of vocational goals. 

Such aptitude measures, however, appear to be less relevant to predicting 
immediate instructional requirements. For example, there is little inf or 
mation about whether spatial or mechanical aptitude is related to parti- 
cular ways in which the student learns. In contrast, measures of student 
behavior obtained in the course of instruction, as performance is contin- 
uously assessed, should provide better information about the kinds of 
instructional alternatives that should be made available to the student. 



4. gonti nnous monitoring a nd assessment. As the student proceeds 
along the course of Instruction, his performance is monitored and contin- 
uously assessed in terms of the established decision points. Measures are 
obtained similar to those used to assess initial placement, but in addl 
tion, new measures are obtained which are specifically related to the 
student’s learning characteristics: For example, how much practice does 

he require? What kind of instructional alternatives does he enjoy? Is 
he slow and steady or impulsive? How well does he retain what he has 

Information of this kind, updated as the student progresses 



learned? etc. 
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should provide the primary information for the decision making required 
to guide student learning. This information would incorporate and super- 
sede initial long-term aptitude measures and placement information. 

Implicit in the proposed model of individualised instruction is the 
assumption that most or all of the students can master, to a defined cri- 
terion of competence, the goals and subgoals along the path of learning. 

The basic task in adapting instruction to individual differences is to 
determine the methods and materials that will enable most students to 
attain mastery. It is no longer assumed, as it is in conventional instruc- 
tion, that student attainment will follow a normal distribution of grades- 
some failing, some excelling, and some falling in between. What eventually 
distinguishes students is their degree of understanding of a subject matter 
and this is a function of how much they learn, and the extent to which they 
are taught to use their knowledge to learn new things, to generalize to 

new situations and solve problems, and to be creative. 

For the above assumptions underlying individualized instruction, it 
is necessary to employ techniques for measuring student achievement which 
are different from generally used measurement practices. In the context 
of the instructional model, a student's perform -i-e can be measured with 
reference to the behavior described in each subgoal. The measure of achieve 
ment indicates the degree to which the student has attained or surpassed 
the described level of competence. The measure gives information about 
the nature of the student performance and in addition, gives the relative 
standing of the student in a group of his peers. Most standardized and 
generally used measures of achievement assume a distribution of attain- 
ment and provide only information about a student’s performance in relation 
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to others: for example, grade placement scores or percentile scores. 

These measures provide Information about relative performance but do not 
provide information about student performance In terms of criterion levels 
of achievement. In the model for Individualized instruction, achievement 
measures are criterion-referenced rather than only norm-referenced in 
order to assess the outcomes of learning at each selected decision point. 

In a non-automated individualized situation, providing this informa- 
tion for dally activities requires a great amount of record keeping and 
clerical summarization. With CMI help, record keeping is still necessary 
but procedures and forms can be devised for placing this Information in 
the computer and printing i*. out in a format useful to the teacher. The 
teacher might be presented with a summary statement on the basis cf which 
he could make decisions, and certain decisions might be suggested to him. 
Accomplishing this may be less complicated than it sounds since decisions 
by the teacher and/or the student may be relatively simple to make, once 
performance information and instructional alternatives are presented to 
them. 

5. Adaptation and optimization . As the student learns, information 
^ls obtained about the characteristics of his learning; instructional assign- 
ments take place; and assessment is made of performance at the subgoal deci- 
sions points. This three-way relationship between learning measure, instruc- 
tional alternatives, and criterion measures becomes a continuing operation 
throughout the course of instruction. What is obviously very important in 
this context is the nature of the measures of the criterion behavior of 
the subgoals. Since the measures of learning history and instructional 
alternatives are evaluated in terms of subgoal performance, the particular 
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measures of master? that are optimized become critical. Depending upon 
the measures used, some gain, will be maximised and other, minimised; 
some kind, of .tndent performance may be minimised inadvertantly unle.. 
they are expressed and axplicitly assessed. It is fur this reason that 
the model requires criterion-referenced measures of the desired outcomes 
of education. The continuous pattern of assessment and instructional 
prescription is a multi-stage decision process which is directed toward 
establishing the most effective sequence of Instruction, as Judged by 
the student and the teacher, for attaining selected educational goals. 

In practice, an underlying conception of how learning proceeds influ- 
ences the interaction between outcome measures, instructional variables 
and individual learning characteristics. Different measures and different 
instructional alternative, can provide a very large number of possible 
learning paths; however, many of these path, are ruled out if constraint, 
are supplied about how learning occurs. In a non-automated individualised 
system, the teacher's conception of how learning occurs influences the 
decisions he makes, and the information with which he is supplied also 
provides such constraints. In CMI, the displays to the teacher and any 
more detailed suggestion, to him presuppose conceptions about the nature 
of learning; and since both teacher and computer are involved, the con- 
ception built into the system and the teacher’s conceptions interact. 

6. Egjlatlonari operation . A primary property of the instructional 
system described her. is that it accumulate, information which 1. used to 
improve it. own functioning. Improvement take, place in two ways: (a) 

The system uses procedures and materials in keeping with the state 
knowledge, and data obtained during the operation of the system allow 
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these procedures end neterials to be node -ore efficient; end (b) new 
knowledge about the learning process end ebout the conduct of Indivi- 
dualised instruction een be obtained. Since the learning of each indi- 
vidual Is carefully monitored, the system makes It possible to explore a 
variety of research questions. In fact. In its early use, the system 
should be over-monitored for this purpose; as It becomes more operational, 

less information needs to be provided e 

A plan for research and development in individualised Instruction at 

the learning Research and Development Center (LRDC) at the University of 
Pittsburgh Includes the transition from a non-automated Individualised 
procedure to a CMI system which eventually will Include CAI as one avail- 
able instructional means. Mon-automated XPI serves the purpose of forcing 
redesign of the organisation of the school. It also calls to the attention 
of the teacher the necessity for detailed Individual student Information. 
This has facilitated the Introduction of teacher Inquiry terminals to be 
used for CMI. Following this familiarisation with the potential of com- 
puters, various computer-based components In various areas can be Intro- 
duced. The general Instructional model described above should permit the 
Incorporation of each of these as appropriate knowledge end technology 
become available. 

tpt aa an Implementati on of the Model 

In Individually Prescribed Instruction, the entire curriculum In eech 
subject area (mathematics, reading, and science) has been broken down Into 
instruction units for subgoals of achievement. For example, the math 
curriculum has identified 430 specific Instructional objectives. These 
objectives are grouped Into 88 units. Each unit comprises an instruc 
tlonal entity which the student works through at any one time; on the 



g 



ami 



m 



■mmmm 







15 



average there are five objectives per unit, with a range of 1 to 14. A 
set of units covering different subject areas In mathematics comprises a 
level; levels can be thought of as roughly comparable to a school grade 
level. On entering the school, the student takes a placement test which 
places him In a particular unit. If his profile is scattered, he begins 
work on the lowest numbered unit. A unit has associated with it a pretest 
and a posttest, and each objective (or skill, as it is called in the sub- 
sequent printouts) within the unit has attached to it one or more curriculum- 
embedded tests. Following placement to a unit, the student takes the unit 
pretest which attempts to diagnose the student's profile within the unit. 

For example, he may have mastered objectives 1, 2, 4 and 5, but not 3, 6, 

7 and 8; at this point, the teacher prescribes for him work related to the 
objectives he has not mastered. As a student works through a lesson, he 
takes, at the teacher's discretion, the curriculum-embedded test which 
assesses whether mastery has been attained on the objective and also to 
what extent some competence has been attained on the next objective. When 
all objectives have been mastered, the unit posttest Is taken. If 85% is 
attained on this test, the student begins the next unit; if not, he Is 
reassigned to an appropriate objective In the unit until he masters It. 
Various discretionary powers are left to the teacher about whether to keep 
the student in a unit or to move him ahead. 

Computer Assistance for IPI 

Designing and Implementing a computer system to facilitate the opera- 
tion and evaluation of IPI was simplified by the fact that the IPI system 
had already been In operation at the Oakleaf School for three years. The 
clerical operations which had evolved over that three-year period helped 
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to clarify the nature of the data and the types of question* which tended 
to be asked of these data. In addition, memoranda were collected from 
experienced staff members summarizing the types of questions they wanted 
to ask of the IPI data base. All of this helped define the content and 
the organization of the data files. An analysis of the types of data 
generated by the operation of IPI and the types of inquiries which teachers, 
evaluators and researchers wanted to make of the data determined the design 
of a first approximation to a computer management system for IPI. 

The system design also took into account available computer hardware. 
This included the University of Pittsburgh IBM 360 model 50, and IBM 1050 
terminal with card reader attachment and three IBM 2741 terminals. The 
central processing unit has extended core which allows up to 32,000 bytes 
per on-line terminal. A 250 million byte disk and six tape drives were 
also part of the 360 configuration. The 1050 terminal was located at the 
school and connected by leased line to the IBM 360 computer on the Univer- 
sity compus. The IBM 2741 terminals are located at the LRDC. This CMI 
system is called IPI/MIS, the IPI Management and Information System. 

The major aspects of the IPI/MIS system as it is operating today are 
summarized in Figure 1. The basic data are recorded on optical scan forms 
by clerks located throughout the school. These forms are brought together 
and processed at the IBM 1232 optical scanner. The resulting punched cards 
are then read by the 1050 terminal at the school and the data edited and 
added to the current student file on disk at the 360 computer. If errors 
are detected in the editing, diagnostics are sent back to the school termi- 
nal for correction. The student disk file contains test and prescription 
data on the unit in which the student is currently working and selected 



background data* When a 



student completes a unit, the data obtained 

during that unit are written out on a scratch file on disk. At the end 
of the day, a program updates the student tape from the scratch file. The 
student tape contains all the instructional history available for each 
student. The tape file is organized by student and consists of a variable 
number of fixed length records for each student, the number depending upon 



the number of instructional units he has completed. Also included are 
background data collected at the beginning of each school year such as 
standardized test results, home background data, sex, homeroom, etc. 

There are four major functions which the MIS can provide in an Individ 



ualized school: (1) collect data; (2) monitor student progress; (3) pro- 

vide prescription information; (4) diagnose student difficulty. These 
functions have two primary objectives: to increase the effectiveness of 

the model for individualizing instruction and to maximize the productivity 

of the teacher operating the IPI system. 

During the fourth year of IPI operation, school personnel included 

one principal, twelve teachers, and twelve teacher aides. The primary 
function of the aides was to score tests and record test results. They 
also tabulated data for inquiries by the principal, teacher, and LRDC 
research and curriculum design staff. The three main functions of the 
teachers have bee writing prescriptions, diagnosing student difficulties, 
and tutoring individuals and small groups of students. The clerical and 
teacher load can be reduced by having data entered directly by teachers 
and students at classroom terminals. The teacher load can be reduced by 
having the computer assume some of the prescription and diagnosing functions, 

thus freeing more time for instruction. 

A description of three possible reports which are now available from 
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the 1050 terminal at the school should help clarify how the system is 
facilitating school operations. The most frequently used report is illus- 
trated in Printout 1, which is a unit summary for a particular student. 

(Last names have been deleted for these Illustrations.) This printout 
is most frequently requested following the failure of a posttest so that 
the student’s work in that unit can be reviewed and appropriate prescrip- 
tions made. As seen in Printout 1 the top of the table sunmarizes his 
pretest and posttest scores for each skill in the unit. It also indicates 
the date (as day of school year) upon which each of these tests had been 
taken. Prescriptions and curriculum-embedded test (CET) scores follow, 
again by date and skill. For this unit, for example, it is possible to 
trace what this student did in math from the fourth day of school to the 
27th day of school; not only what he did but how well he did. 

The computer report illustrated in Printout 2 summarizes all of the 
work being done by the students in a particular homeroom. This summary 
of where each student is in the curriculum and how long he has been there 
is used in the teachers* group-planning sessions, together with Printout 3, 
to help decide which student seems to have gotten "bogged down" in his 
progress and which students might be used to help in tutoring. Also, 
Printout 3 provides information as to which students might be brought 
together for group work in a unit. 

One shortcoming of the present system is that the school has only one 
terminal and it is in the data room and not the classroom. The teacher 
who is making prescriptions on a continuous basis does not have time to 
send "down the hall" for the required report, so those needed reports must 
be anticipated by the teacher and/or the system. Also, it usually takes 
about a day or two for the scan forms to go through the various processing 
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steps to finally reach the computer’s disk storage. 

The next apparent step In the development of IPI/MIS Is to Install 
a terminal network at the school so that both teachers and students can 
have convenient access to computer terminals. A single terminal in the 
school cannot provide the data collecting, the monitoring, the teacher 
inquiry and diagnosis functions needed. Classroom CRT terminals would 
allow data to be entered directly into the system quickly and easily. 

Terminals in each classroom would also facilitate student diagnosis. 
Occasionally a student will get "bogged down" in a particular unit and 
none of the available tests for that unit reveal the nature of the stu- 
dent difficulty. That is, the tests for a given unit measure the unit’s 
objectives and not the prerequisite behaviors. Although the student may 
have previously "mastered" prerequisite behaviors, he may have moved on 
to another unit prematurely due to errors of measurement, or he may not 
have retained the necessary behavioral repertoire for the current unit 
in which he is having difficulty. Currently, the teacher attempts to 
diagnose the difficulty through questioning the student in a type of 
clinical branch testing. It is possible that this can be done much more 
effectively using a computer-assisted branch testing approach. Given 
the current unit in which the student is having difficulty and given the 
prerequisite behaviors for that unit, items can be presented for on-line 
student response which should facilitate the identification of the missing 
knowledges or skills. Prescriptions can then be written for appropriate 
lesson units. 

The first year of developing and implementing IPI/MIS suggested 
several changes in both the instructional system (IPI) and in the computer 
support system. However, it is clear that more fundamental advances will 
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come through a systematic program of evaluation and research. The avail 
ability of the MIS should facilitate such a program. 



IPI Research and Evaluation 

The IPI educational system, consisting of units geared to assessable 
objectives, is very amenable to the type of evaluation called for In the 
sixth step of the instructional model. The Instructional units are used 
in an environment in which relevant information Is readily available on 
the participating students and teachers. Information regarding the rela- 
tive effectiveness of different units designed to meet the same objectives 
can be systematically collected so that decisions can be made regarding 
which units are more appropriate for what kinds of students at what points 
in their educational development. Weak units among those offered can 
be identified and replaced in the system. Objectives for which no adequate 
units are now available will be discernible and appropriate units developed 
This, in turn, will lead to a more potent system of education for each stu- 
dent which more and more closely approximates desired goals. 

In addition to the "is it working?" type of evaluation studies, the 



retrieval and analysis sytem and the IPI data bank provide a vast resource 
for basic learning and measurement studies. The scientist has quick and 
convenient access to the data so that if he gets "hot" on a particular 
question he can interact with the data and his hypotheses at the moment 
rather than wait for weeks between getting an idea and seeing the first 
printout. Evaluation and research requirements have been given a high 



priority in development of the IPI/MIS. The system is now operation 1 to 
the extent that learning psychologists and curriculum evaluators can sit 
at the computer terminal and retrieve data for selected students or units 
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requests. He can edit the requested data If necessary, and proceed with 
an appropriate data analysis of the retrieved, edited data. The student 
history file, containing all of the data collected on all of the students 
for one academic year, can be searched in three to five minutes, depending 
upon the demands being placed on the computer by other terminals at that 
same time. An example of this search is provided in Printout 4. 

In the Printout 4 example, the investigator was interested in examining 
selected data for all of the students who had taken the pretest in E level 
subtraction in mathematics (unit e4). Line four (4.) of the search para- 
meters is the primary selection criterion, which is indicated by ending the 
line with a period. This command directs the search routine to select only 
those students who had taken the pretest for unit e4. The lines ending 
with an exclamation mark indicate data to be retrieved for the selected 
students If it is available; for example, line five (5.) is a request for 
the prescription information on students who worked on the first objective 
(skill) in unit e4. This search resulted in a work file (called "e4 stuff" 
by the terminal user) of 32 students. The file contained the unit perfor- 
mance data for those students plus some background data requested for them, 
that is, their Otis IQ scores and their Stanford Arithmetic computation 

percentiles, if available in the file. 

Current research applications of the MIS are primarily concerned with 
three major aspects of IPI and their interrelationships: (1) the diagnostic 

tests; (2) the prescription behavior of teachers; and (3) the content and 
sequence of the curriculum materials. The first three years of IPI required 
a tremendous effort to develop the necessary tests and curriculum materials. 
Also, teacher retraining was a large task. These developmental activities 
were primarily and necessarily departmentalised; that is, a group of test 
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specialists developed the test battery, while subject matter experts In 
the various curriculum areas developed the materials and their sequence. 
Other staff members worked with the teachers In developing their new 
mode of teaching. The real challenge now Is to Investigate the function- 
ing of all of these components and their Interactions. The computer Infor- 
mation system makes this large task more feasible. 

For example, Bolvln (1967) has observed that there Is considerable 
variance In prescriber behavior. Some teachers tend to assign a bare 
minimum of study and practice and then assign a posttest to see whether 
the student requires more study and practice for that particular unit; 
they thus go back and forth between prescription and posttest until 
mastery Is apparently achieved. Other teachers are moderate prescrlbers 
and tend to "follow the book" strictly In terms of the pretest scores; no 
work Is prescribed If the pretest skill scores Indicate greater than 85% 
mastery, and If less than 85%, the extent of the assignment Is determined 
by the degree to which the pretest score deviates from that mastery goal. 
Still a third type of prescriber tends to "over prescribe." That is, stu- 
dents generally are assigned much more work than would seem to be indicated 
by the pretest scores. A systematic analysis of the data involving pre- 
scriber, prescription, and subsequent student performance will help clarify 
the relative effectiveness of these different prescription behaviors and 
will suggest whether or not they should vary depending upon the student 
and type of behavior being taught in that unit. For example, it may be 
important that certain skills be given extensive practice (computation for 
example) so that in subsequent, more complex units requiring those skills, 
achievement is not hampered through lack of retention. Printout 5 is an 
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Illustration of data relevant to this area of concern. Note how the num- 
ber of tasks prescribed varies for the same pretest scores, depending In 

part upon who did the proscribing • 

Another line of current Inquiry Is concerned with the structure of 

curriculum sequences. For only ten objectives there are over three million 
possible sequences. Fortunately, most of these sequences are ruled out by 
content structure and conceptions of the learning process . Instruct 
sequences can, however, also be empirically studied. Techniques similar 
to multiple scalogram analysis (Lingoes, 1963) of available placement and 
pretest results can assist In determining whether or not the objectives are 
being taught In the order of their difficulty and ease of successive facili- 
tation of the next learning stage. It Is also possible to see whether or 
not the extent to which objectives are not In order of difficulty affects 
the time It takes for students to master that particular sequence of 
objectives and their eventual ability to use what has been learned. 

Printout 6 Illustrates the results of a multiple scalogram analysis of 
pretest skill mastery data for a math unit. On the left the seven objective, 
for this unit are sequenced in their present order. On the right, the com- 
puter program puts them in order of difficulty < 1 , 4 , 7, 2,6, 3, 5) and then 
assesses the extent to which they "scale." That Is, do students who pas. 
(Indicated with a 1) skill 5 also tend to pass the other six skills In the 
set. Similarly, does falling (0) skill 7 Imply falling skills 2. 6, 3, 
and 5. for example. The program Indicated that this was a reasonably good 
scale. Whether or not the resulting new sequence Is more effective In facili- 
tating learning can, of course, be empirically examined. 

A more fundamental task which MIS can facilitate Is the development of 
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alternate forms of Instruction that are adaptive to student profiles. 

Of course, now a student can be assigned to material In which he shows 
a lack of mastery; and he need not be assigned to lessons for which his 
mastery is satisfactory. But in addition, lessons may involve different 
kinds of vocabularies; they may involve more or less closely sequenced 
instruction; or they may Involve instruction which puts more or less of 
a burden on the student to manage his own progress. Essentially, the 
problem is to determine different instructional alternatives that are 
related to different patterns of learning. The goal of the IPI/MIS is 
to help with empirical work which would determine the measures most 
efficient for assigning individuals to alternatives and the necessary 
alternatives that need to be made available. 

Toward CA1 

The development and adoption of the type of individualized model 
proposed here seems to be a necessary prerequisite for bringing CAI out 
of the "backroom" and into the classroom. It seems unlikely that CAI 
will ever provide all of the instruction for all of the students all of 
the time. Yet it is virtually impossible to incorporate CAI into tradi- 
tional schools where the classroom of students is the basis for instruc- 
tional decisions and scheduling. On the other hand, it is easy to incor- 
porate CAI lessons into IPI/MIS as those lessons become available for 
solving specific instructional problems. The computer is there, the ter- 
minal capability is there, and the flexibility of an individualized school 
organization is there. Most important, a model for individualization is 
there. It seems reasonable that the same instructional model which guided 
the development of IPI and is guiding IPI's "automation," can guide the 
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development and implementation of CAI In an Individualized school. Some 
din of these aspects seems to be the end toward which we are currently 



striving. 
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Footnotes 



1. The preparation of this paper and the research and development 



described herein were performed pursuant to a contract with the 



U. S. Office of Education, Department of Health, Education and 



Welfare. Additional support has been provided by the General 



Learning Corporation. 

2.* Although we are not completely happy with all of the connotations 



of computer-managed Instruction . It does seem to be the expression 
most frequently used by people currently working In this general 
area of concern. It should be emphasized that the computer here 



Is used as a tool In the management of the Information needed by 



teachers In planning Individualized education. 



3. See, for example, Cooley (1967) for a more detailed consideration 



of guidance in the Individualized school. 



4. The specification of models for Individualizing education, the 
development of IPI, the Implementation of CM I , and the eventual 
incorporation of CAI In Individualized schools are major activities 
at the Learning Research and Development Center. We wish to take 



this opportunity to thank our many colleagues and students who 



have contributed to these efforts. 
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Major aspects of IPI/MIS 



0512 M . . . , KELLY 



DATE - 030 



CURRENT 


math is level f division 






PRETEST 




POSTEST 


SCORES 


SKILL 


SCORES 


1ST 


2ND 


3RD 


1 


99 


99 


50 




2 


50 


99 


99 




3 


00 


50 


50 




4 


75 


50 


50 




5 


60 


80 


40 




6 


99 


99 


67 




7 


75 


99 


99 




8 


33 


67 


33 




DATE 


004 


018 


029 




PRESCRIPTIONS AND 


CETS 






DATE 


SKILL 




PAGE 


- SCORE 


010 


02 


01-90 


02-80 03- 


90 04-90 






08-90 


09-90 








CET 10 


PART 1-99 


PART 2-00 


013 


03 


01-90 


02-90 03- 


90 04-90 






08-90 


09-90 10-90 12-80 






14-60 


15-90 








CET 16 


PART 1-25 


PART 2-67 


015 


03 


CET 22 


PART 1-88 


PART 2-99 


016 


04 


CET 10 


PART 1-99 


PART 2-99 


016 


05 


CET 10 


PART 1-85 


PART 2-99 


017 


07 


CET 10 


PART 1-99 


PART 2-99 


017 


08 


CET 07 


PART 1-99 


PART 2- 


021 


03 


CET 20 


PART 1-75 


PART 2- 


021 


04 


CET 10 


PART 1-75 


PART 2-99 


023 


05 


CET 10 


PART 1-85 


PART 2-99 


023 


05 


09-90 


11-90 12 


-90 






CET 13 


PART 1-99 


PART 2-67 


026 


03 


» 

CET 16 


PART 1-99 


PART 2-00 


027 


08 


CET 07 


PART 1-99 


PART 2- 


027 


05 


CET 10 


PART 1-99 


PART 2-99 




4TH 



06-90 



07-90 

13-90 



Printout 1. Unit summary for a single student. 
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Sfif 










GRADE 6 



MRS. FAYE MUELLER 



DATE - 036 



MATH 



ID 




NAME 


SKILL 


0306 


A . 


. , JOHN 


04 


0317 


A . 


. , LOUANNE 


05 


0339 


B . 


. , LINDA 


01 


0341 


B . 


. , ROBERTA 


05 


0352 


B . 


. , MARK 


04 


0374 


D . 


. , RICHARD 


05 


2052 


C . 


. , MARLENE 


02 


2096 


H . 


. „ GILBERT 


01 


2041 


H . 


. , ROBERT 




0705 


K . 


. , PAUL 


04 


0693 


Z . 


. , JANICE 


06 


0682 


W . 


. , KIMBERLY 




0671 


V . 


. , EDGAR 


07 


0669 


T . 


. , MICHELE 


04 


0636 


S . 


. , MARY ANN 


02 


0614 


P . 


. , DENISE 


08 


0603 


P . 


. , TIMOTHY 


02 


0591 


P . 


. , ROBERT 


11 


0567 


M . 


. , PEGGY 


03 


0545 


M . 


. , MICHAEL 


05 


0512 


M . 


. , KELLY 


08 


0501 


L . 


. , LINDA 


07 


0498 


L . 


. , RONALD 


04 


0487 


L . 


. , MICHELE 


02 


0443 


K . 


. , KEVIN 


06 


0432 


K . 


. , KAREN 


04 


0421 


K . 


. , MICHELE 


03 


0419 


J • 


. , WILLIAM 


01 



UNIT 



F 

E 

F 

F 

E 

E 

D 

E 

E 

E 

E 

F 

E 

E 

E 

F 

D 

E 

F 

D 

F 



E 

E 

E 

E 

G 

G 

E 



COMBINATION OF PROCESSES 

FRACTIONS 

DIVISION 

MULTIPLICATION 

MULTI PLICATION 

NUMERATION 

SYSTEM OF MEASUREMENTS 

ADDITION 

MULTIPLICATION 

FRACTIONS 

FRACTIONS 

NUMERATION 

COMBINATION OF PROCESSES 

DIVISION 

MONEY 

DIVISION 

SYSTEM OF MEASUREMENTS 

MULTI PLICATION 

MULTI PLICATION 

SYSTEM OF MEASUREMENTS 

DIVISION 

NUMERATION 

MULTIPLICATION 

NUMERATION 

SYSTEM OF MEASUREMENTS 

MULTIPLICATION 

NUMERATION 

MONEY 



Printout 2. Class list showing how long 
each student has been working in his current unit. 




DAYS 



8 

31 

4 
31 

30 

5 
8 
3 
1 

31 
31 

5 

31 

29 

5 

31 



31 
28 
24 

32 

33 
9 
5 

31 

7 

31 

3 



1 



j 
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GRADE 6 MRS. FAYE MUELLER 



DATE - 036 MATH 



D SYSTEM OF MEASUREMENTS 

2052 C . . / MARLENE 
0545 M . . * MICHAEL 
0603 P . . , TIMOTHY 



SKILL 

02 

05 

02 




E NUMERATION 


. , RICHARD 


05 


0374 D . 


0487 L • 


. , MICHELE 


02 


0501 L • 


. , LINDA 


07 



E ADDITION 

2096 H 



GILBERT 



01 



E MULTIPLICATION 
0352 B . . 


, MARK 


04 


2041 


H . . 


, ROBERT 


04 


0498 


L . . 


, RONALD 


0591 


P . . 


, ROBERT 


11 



E DIVISION 

0669 T 



MICHELE 



E COMBINATION OF PROCESSES 
0671 V . . , EDGAR 



04 



07 



E FRACTIONS 
0317 A 

0705 K 

0693 Z 



LOUANNE 

PAUL 

JANICE 



05 
04 

06 



m mmm 



E MONEY 

0419 J 

0636 S 



WILLIAM 
MARY ANN 



E SYSTEM OF MEASUREMENTS 
0443 K . . / KEVIN 



F NUMERATION 
0682 W 



KIMBERLY 



F MULTIPLICATION 
0341 B . . 

0567 M . . 



ROBERTA 

PEGGY 



F DIVISION 

0339 B 
0512 M 
0614 P 



LINDA 

KELLY 

DENISE 



01 

02 



06 



05 

03 



01 

08 

08 



F COMBINATION OF PROCESSES 
0306 A . . / JOHN 



04 



G NUMERATION 

0421 K . 

G MULTIPLICATION 
0432 K . 



MICHELE 


03 


KAREN 


04 



Printout 3. Class list sortin* students tov unit. 
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<foarch Example :* 

>$$logon e65wwc. 

>$$att d stutape as xx. 

>$$load d search. 

TYPE THE FILE NAME OF THE STUDENT TAPE. 
>xx 

THE STUDENT TAPE IS DATED 042068. 

LIST YOUR SEARCH PARAMETERS. 



1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 



> i d. 

>otis iq! 

>st acp^lle! 

>math pret,e4,=l. 
>math presc,e4, ski 1 1 
>math presc,e4,ski 1 1 
>math presc / e4 / ski 1 1 
>math post,e4, s l! 
>end. 



1(1), cet ! 
2(1)/Cet ! 
3(1)/Cet ! 



PARAMETER LIST COMPLETE 
DO YOU WANT YOUR OUTPUT 
>disk 



ON TAPE OR DISK? 



0 



SPECIFY DATASET NAME. 

>e4stuff. 

COMPILATION BEGINS. 

(diagnostics printed here if there were errors 



in the search parameters) 



COMPILATION COMPLETE 
OUTPUT FORMAT: 

ONE BACKGROUND RECORD OF 09 BYT ^ n p |5 11 ^,$ ENT * 
ONE OVERALL RECORD OF 91 BYTES PER STUDENT. 

SEARCHING BEGINS 



YOUR OUTPUT FILE CONSISTS OF 32 STUDENTS. 
THE SEARCH IS COMPLETED 



M: END OF JOB 



Lines 

other 



typed following the > were typed by the terminal user 
lines were typed under computer program control. 



The 



Printout 4. Illustration of the tape retrieval program. 




>$$att d d8stuf f (e65wwc) as F8. 
>$$load d main. 

LOADING STARTS AT LOC 070200 



PRETEST, PRESCRIPTIONS, AND POSTESTS FOR MATH D8 SKILL 2. 



ID 


PRETEST 


294 


70 


102 


70 


124 


60 


168 


80 


181 


70 


226 


70 


317 


80 


341 


80 


352 


70 


363 


70 


385 


60 


408 


70 


432 


80 


476 


50 


501 


60 


567 


60 


578 


50 


614 


80 


636 


30 


647 


70 


669 


60 


671 


70 


682 


80 


693 


60 


1058 


50 


1036 


80 


1025 


70 


1814 


60 


999 


60 


738 


50 


1105 


80 


1116 


50 


1173 


80 


1231 


60 


1242 


70 


1297 


50 


1333 


0 


1377 


70 



PRESCRIPTIONS (UNIT TASK NUMBERS) 



1 2 3 5 6 7 15 

2 3 8 9 10 13 14 

4 6 7 10 11 13 

9 12 3 16 17 15 

4 6 7 8 9 10 12 

1 2 3 4 5 6 7 

1 5 6 7 16 17 

4 6 9 11 

1 2 3 4 5 7 9 

6 7 8 9 10 11 12 

5 6 7 8 12 13 14 

2 3 4 6 7 13 15 

5 6 7 

1 2 3 4 6 7 9 

1 2 4 6 7 8 9 

1 2 6 7 11 13 15 

4 5 6 7 11 13 15 

1 5 7 11 12 

1 3 6 10 13 14 17 

1 16 17 

1 2 3 4 7 9 11 

5 6 7 11 12 13 14 

5 7 8 9 22 23 13 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

3 7 8 9 13 

1 2 10 16 17 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 5 6 7 

7 11 13 9 

1 2 3 4 5 6 8 

1 2 3 4 5 8 8 

1 2 3 5 6 8 10 

3 4 5 6 7 8 9 

1 2 3 4 6 7 8 

1 2 3 4 6 7 13 

1 3 5 6 7 8 9 



16 








15 


17 






14 


16 






8 


10 


11 


13 14 15 


10 


12 


14 


17 


14 


17 






15 








11 


12 


14 


17 


13 


15 






16 


17 






16 


17 







13 


15 


17 








15 


16 










15 












9 


10 


13 


15 


16 


17 


8 


10 


11 


12 


13 


14 



8 


9 


10 


11 


12 


13 


8 


9 


10 


11 


12 


13 



10 


13 


15 


17 






9 


11 


13 


15 


16 


17 


11 


12 


14 


17 






15 


16 


17 








10 


11 


13 


15 


16 


17 


14 


16 


17 








10 


11 


12 


13 


14 


15 



PRESCRIBER 


POSTEST 


6 


90 


6 


99 


6 


60 


6 


80 


0 


99 


9 


80 


5 


99 


5 


90 


10 


90 


10 


99 


5 


99 


10 


99 


10 


90 


10 


70 


5 


90 


5 


70 


5 


90 


10 


90 


5 


99 


5 


99 


10 


80 


5 


90 


5 


99 


5 


80 


4 


70 


4 


99 


4 


80 


9 


80 


4 


70 


4 


50 


3 


99 


3 


80 


11 


90 


3 


99 


3 


90 


3 


90 


3 


99 


3 


90 



M: END OF JOB 



Printout 5. Pretest, prescriptions and 
posttests for skill 2 of mathematics unit D Division. 







ORIGINAL SEQUENCE 



REORDERED SEQUENCE 



J_D OBJECTIVE 

12 11111 



OBJECTIVE 

112 2 111 



0421 

0113 

0875 

0567 

0432 

0614 

0328 

0339 

0192 

0055 

0124 

0088 

0922 

0259 

0512 

1253 

0556 

0066 

0077 

0168 

0179 

0181 

0237 

0248 

0738 

0272 

0625 

0682 

1003 

0408 

0818 

0011 

0443 



1111111 
1111111 
11110 0 1 
10 110 11 
110 10 0 1 
110 10 0 1 
110 10 0 1 
0 10 10 11 
10 0 10 11 
110 10 10 
10 110 0 1 
110 110 0 
10 110 10 
1 0 0 1 0 0 1 
1 0 0 1 0 0 1 
1 0 0 0 0 1 1 
1 0 0 1 0 0 0 
0 1 0 0 0 0 1 
1 0 0 1 0 0 0 
1 0 0 1 0 0 0 
1 1 0 0 0 0 0 
1 0 1 0 0 0 0 
1 0 0 0 0 0 1 
1 1 0 0 0 0 0 
1 0 0 0 0 0 1 
0 1 0 0 0 1 0 
1 0 0 0 0 0 0 
1 0 0 0 0 0 0 
1 0 0 0 0 0 0 
1 0 0 0 0 0 0 
1 0 0 0 0 0 0 
0 0 0 0 0 0 0 
0 0 0 0 0 0 0 



1111111 
1111111 
11110 10 
1110 110 
11110 0 0 
11110 0 0 
11110 0 0 
0 11110 0 
1110 10 0 
110 110 0 
1110 0 10 
110 10 0 1 
110 0 110 
1 1 1 0 0 0 0 
1 1 1 0 0 0 0 
10 10 10 0 
1 1 0 0 0 0 0 
0 0 1 1 0 0 0 
1 1 0 0 0 0 0 
1 1 0 0 0 0 0 
1 0 0 1 0 0 0 
1 0 0 0 0 1 0 
1 0 1 0 0 0 0 
1 0 0 1 0 0 0 
1 0 1 0 0 0 0 
0 0 0 1 1 0 0 
1 0 0 0 0 0 0 
1 0 0 0 0 0 0 
1 0 0 0 0 0 0 
1 0 0 0 0 0 0 
1 0 0 0 0 0 0 
0 0 0 0 0 0 0 
0 0 0 0 0 0 0 



Printout 6. Comparison of original versus reordered 
response pattern for mathematics unit E Division. 









